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PREFACE 

This  Memo  rand  vim  describes  the  computer  programming 
system  used  In  the  study  of  general  neural  nets,  presented 
In  RM-3^06-PR,  A  General  Neural  Net .  E.  W.  Paxson  and 
J.  W.  Smith,  The  RAND  Corporation,  November  1962. 

The  present  Memorandum  Is  concerned  with  the  details 
of  the  electronic  digital  simulation  of  such  a  net,  and 
serves  as  an  adjunct  to  the  earlier  Memorandum.  The 
study  is  part  of  the  Project  RAND  research  program  In 
physiological  communications  systems . 


SUMMARy 


A  computer  programming  system  for  Investigating 
general  neural  net*  activity  Is  described.  The  system, 
called  NETl,  allows  Investigators  to  construct  nets, 
maintain  files  of  nets,  and  compose — and  execute— pre¬ 
planned  programs  of  experimentation  on  nets.  Such 
experimental  programs  may  effect  repeated  simulations  of 
a  single  net  or  collection  of  nets  with  Inter-slmulatlon 
variation  of  net  components,  parameters,  and  stimuli; 
and  may  Interrogate,  test,  and  vary  such  elements  within 
an  Individual  simulation. 

NETl  operates  within  the  RAND  version  of  the  SHARE 
Operating  System  (SOS)  for  the  IBM  7090.**  Net  capacity 
and  ratio  of  c<»iputlng  time  to  physiological  time  are 
discussed  for  that  machine. 

*E.  W.  Paxson  and  J .  W.  Smith,  A  General  Neural 

The  RAND  Corporation,  RM-3^06. 

0.  E.  Bryan,  Ed.,  The  RAlg)-SHAIg  Operating  Sys- 
^m  for  the  IBM  7090  Computer,  ^e  )^Alrt)  Corporation. 
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1.  IHTRODUCTION 


A  neural  net  is  a  set  of  nodes  and  their  Intercon¬ 
nections  which  purportedly  have  some  of  the  observed 
properties  of  neurons  and  their  axonal  connections.  A 
general  neural  net  is  a  computer  program  which  simulates 
the  behavior  of  neural  nets  by  computing  the  events  that 
occur  at  neuronal  synapses,  within  neurons,  and  along 
the  connecting  links. ^ 

NETl  is  a  programming  system  for  general  neural  net 
experimentation.  It  is  operative  on  the  IBM  7090,  and 
requires  the  RAND  version  of  the  SHARE  Operating  System 
for  that  machine. 

NETl  was  designed  to  function  as  a  technical  as¬ 
sistant  for  neural  net  Investigators.  Such  an  assistant 
should  be  able  to:  construct  nets  from  structural 
specifications,  maintain  files  of  nets,  modify  existing 
nets,  and  activate  a  specified  net  or  collection  of  nets 
under  prescribed  conditions  as  directed  by  a  set  of  in¬ 
structions— testing,  modifying,  and  recording  behavior 
and  conditions  as  directed.  To  these  ends,  NETl  contains 
the  following  elements: 

l)  A  descriptive  language  for  specifying  the 
structure  of  nets  In  terms  of  neurons,  connections ,  and 
stimuli. 

^E.  W.  Paxson  and  J.  W.  Smith,  A  General  Neural  Net. 
The  RAND  Corporation,  RM-3406. 
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2)  An  algorithmic  language  for  composing  experi¬ 
mental  programs.  Such  programs  may  construct  nets, 
modify  nets,  effect  repeated  experimental  runs  on  nets 
with  inter-run  variation  of  net  structure  and  environ¬ 
ment,  and  may  interrogate  and  vary  structure,  environment, 
and  behavior  within  individual  runs. 

3)  A  collection  of  computer  routines  for  performing 
the  operations  implied  in  l)  and  2)  above. 

The  main  concern  of  this  Memorandum  is  the  descrip¬ 
tion  of  the  languages  available  for  the  presentation  of 
nets  and  experimental  programs  to  NETl.  In  addition, 
the  main  neural  net  program,  its  capacity  (in  terms  of 
neurons  and  connections),  and  its  computing  times  will  be 
discussed . 

Terms  Introduced  in  context  or  defined  in  RM-3406 
will  be  underlined  the  first  time  they  occur.  Abbrevi¬ 
ations  will  be  introduced  in  parentheses  Immediately 
following  the  first  occurrence  of  a  term. 
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II.  HET  SIMULATION 


That  computer  routine  which  actually  simulates  the 
behavior  of  a  net  Is  called  the  simulator.  Two  were 
originally  constructed  and  compared.  One  operated  as  a 
sequential  simulator — one  that  computes  the  state  of  a 
net  by  systematically  updating  the  entire  net,  neuron- 
by-neuron,  at  fixed  Intervals  of  time.  The  other 
functioned  as  an  event  simulator — one  that  computes  the 
state  of  a  net  In  a  nonsystematlc  manner,  updating  only 
active  neurons  and  connections  (those  that  are  either 
receiving,  processing,  or  transmitting  pulses).  Figure 
1  Is  a  suitably  linearized  and  normalized  graph  of  com¬ 
puting  time  versus  net  activity  for  the  two  simulators; 

activity  meaning  that  of  all  neurons  and  of  all 
connections  are  active. 


Computing 

time 

Met  size 


Pig.  1 


A  cross-over  point,  which  is  characteristic  of  such 
comparisons,  occurs  at  an  activity  level  of  approximately 
40^.  It  was  felt  that  this  level  was  too  low  to  war¬ 
rant  the  use  of  am  event  simulator  for  neural  nets,  which 
are  generally  characterized  by  rather  high  activity 
levels.  Hence  the  simulation  is  a  sequential  one,  from 
tdilch  it  follows  that: 

AT*kT,  k>l,  T=i  millisecond.  (2.1) 

Here,  AT  is  the  updating  Interval,  t  is  the  basic  unit 
of  physiological  time,  and  k  is  the  grain  of  the  simu¬ 
lation,  k=l  giving  the  finest  grain. 

Estimates  of  ratios  of  computing  time  to  physio¬ 
logical  time  for  varying  net  sizes,  and  estimates  of 
maximal  net  sizes  are  presented  in  Appendix  A. 
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III.  NET  DESCRIPTIONS 

A  net  Is  described  by  listing  Its  component  neurons, 
connections,  and  stimuli.  The  list  may  contain  display 
pseudo-components  that  provide,  during  the  course  of  a 

p 

simulation,  stylized  recordings  of  net  behavior.  The 
components  are.  In  effect,  dravm  from  an  alphabet  of 
functional  types,  differentiation  within  a  type  being 
effected  by  parameterization.  Tables  1,  2,  and  3  (pp.  11, 
13 *  15 i  respectively)  list  available  types,  their 
functions  as  net  components,  and  their  parameters.  All 
will  be  discussed.  In  appropriate  detail.  In  succeeding 
sections. 

NETl  expects  the  components  of  a  net  to  be  pre¬ 
sented  on  standard  I£N  cards,  one  per  card.  In  a  format 
which  Is  Invariant  over  component  types.  The  format, 
described  In  Fig.  2,  Is  essentially  functional  notation; 
that  Is,  a  function  name,  followed  by  Its  arguments  sepa¬ 
rated  by  commas. 

/ card  columns  8-15  16-72 

contain  functional  type  parameters  -  separated 

by  conmas  -  In  the 
order  specified  by 
Tables  1,  2,  and  3 


p 

See  Sec.  IV. 


I 


Pig.  2 
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A  collection  of  such  cards >  suitably  delimited « 
constitutes  a  net  description]  the  components  may  be  pre¬ 
sented  In  any  order.  A  net  description  may  be  Improperly 
delimited,  may  describe  an  oversize  net,  or  may  contain 
errors  of  omission,  commission,  and  transcription;  a 
net  so  described  Is  Ill-defined.  NETl  will  comment  on 
such  errors,  taking  appropriate  action  to  Insure  that  It 
accepts  only  well-defined  nets . 

Note  that  all  components  have  one  parameter  type  In 
common — an  Identifier  or  name.  Indeed,  In  order  that 
the  connectivity  of  a  net  be  unambiguously  defined.  It 
Is  necessary  that  Its  components  be  assigned  unique  names. 
Accordingly,  the  following  naming  convention— which  must 
be  honored — has  been  adopted: 

1)  Neuron  names  are  drawn  from  an  alphabet 
of  alphanumeric  couplets. 

2)  Connection  n^Lmes  are  triples  of  alphanumeric 
couplets  of  the  form: 

name  of  originating  neuron 

name  of  destination  neuron 
local  Identification. 

For  example, 

FL  LN  SI  21  22 

are  permissible  neuron  names;  whence. 


FL2101 


liN2201 


SlLNOl 


222101 


■7 


are  proper  connection  names.  The  connectivity  Is  pic¬ 
tured  In  Pig.  3. 


ENFLOl  SlLNOl 


Pig.  3 

Figure  4  Is  an  example  of  a  net  description,  des¬ 
cribing  the  net  presented  dlagramatlcally  In  Fig.  3* 

Note  the  delimiters  BEGIN  and  END;  these  should  have 
appended  to  them,  as  a  parameter,  the  net  name,  which 
Is  necessary  for  future  filing  auid  simulation.  Comment 
cards.  Indicated  by  the  asterisk  In  column  1,  have  been 
liberally  used  for  explanatory  purposes.  SAMPLE,  the 
net  described  In  Pig.  4,  Is  well-defined. 

Refer  again  to  Table  1.  Most  of  the  functional 
types  and  parameters  there  listed  are  self-explanatory 
In  the  context  of  RM-3406.  A  discussion  of  the  unfamiliar 
types  and  of  parameter  conventions  follows. 

Delay  elements  are  single-input,  multiple-output 
components  whose  sole  function  Is  to  delay  the  trans¬ 
mission  of  pulses. 


NET  DESCRIPTION  FOR  NET  OF  FIGURE  3 


BEGIN  SAMPLE 

CYCLIC  ENtOtlOOtl  ZERO  DELAY* 
CYCLIC  SlfOtlOOfl  lOOPPS  RATE* 

CYCLIC  $2*0*100*1  NEVER  FAIL. 

THBASE-llMV.*  THFUNCTI0N*TYPE3*  RHO-2 
FOR  NEURON  FL. 

NEURON  FL*ll*TYPh3*2** 

THBASE-IOMV. *  THFUNC T 1 0N» T YPE 1  *  RH0»2 
FOR  ALL  OTHER  NEURONS 
NEURON  21*10* tYP£l*2*» 

NEURON  22*10*TYPE1*2** 

NEURON  LN*10*TYPE1*2** 


PI  DISPLAYS  FIRING  HISTORIES  OF  •HARKED* 
NEURONS*EXAMINING  THESE  NEURONS  EVERY 
TIME  PERIOD  (KATE>2000PPS)  . 

PRINTC  Pl*0*2000 


ALL 

END-POINTS  FIRE  WITHOUT  FAIL* 

I.L. 

REL 

I  ABILITY 
FACIL 

FOR  ALL  CONNECTIONS 
ENFLOl*!* 1* 15  0ELAY«1* 

AMP»15MV 

PULSE 

FL2101* 1*8* 15 

*8 

*15 

PULSE 

FL2201* 1*4* 14.5 

*4 

«14.5 

PULSE 

222101*1*4*-15 

■4 

«-15 

PULSE 

22LN01* 1* 1*4 

»1 

■  4 

PULSE 

LN2201* 1* 1* 14.5 

*1 

«14.5 

PULSE 

S2LN01*1*6*20 

«8 

»20 

REINF  R1*22LN0L*S2LN01 

SlLNOl  REQUIRES  COINCIDENCES  WITH 

BOTH 

22LNul 

AND 

S2LN01. 

THE  FORGETTING  FACTOR 

IS  TO 

BE 

VARIED  BETWEEN  RUNS. 

LEARN  S1LN01*1*16*20*R1*1.1*2 
END  SAMPLE 


FIGURE  A 
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Relnforclng  sets  are  collections  of  from  one  to 
six  connections  that  act  as  a  reinforcing  consortium; 
learners  that  depend  on  such  sets  require  a  specified 
number  of  simultaneous  coincidences  to  trigger  an  ef¬ 
fective  coincidence — one  that  actually  Increments  the 
learning  function.  Learners  depending  on  reinforcing 
sets,  and  only  such  learners,  must  specify  this  coin¬ 
cidence  count  as  a  parameter. 

Learners  may  specify  Individual  forgetting  rates 
(X),  a  'normal'  forgetting  rate  for  learners  being 
specified  as  a  net  parameter.^  Omission  of  X  from 
the  parameter  list  Indicates  that  the  normal  rate  Is  to 
hold;  when  specified,  X  will  modify  Individual  forget 
ting  rates  according  to  the  following  schema. 


X  < 


>  1 
-  1 
<  1 
L-  0 


higher  forgetting  rate  (slow  learning) 
normal  forgetting  rate 
lower  forgetting  rate  (fast  learning) 
no  forgetting  (incremental  learning) 


It  should  be  noted  that  any  connection  may  be  a  rein- 
forcer.  Indeed,  learners  may  themselves  be  relnforcers, 
with  no  limit  to  the  length  of  such  reinforcing  chains. 

All  delays  (6)  must  be  given  as  fin  Integral 
number  of  basic  time  units  (t  «  i  ms).  That  Is,  If  the 


^See  Sec.  VI. 
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true  delay  were  t  seconds,  then  6  would  be  given  by: 

t  »  6.T  (3.1) 

with  the  further  restriction  that 

1  <  6  <  35  .  (3.2) 

This  constraint  may  be  circumvented  by  cascading  delay 
elements . 

The  absolute  refractory  period  (o)  must  obey: 

t  =  D.T  (3*3) 

where  t  is  the  refractory  period  in  seconds. 

The  threshold  resting  value  (thQ),  pulse  amplitude 
(a),  and  stabilizing  level  (L)  are  given  in  millivolts, 
and  may  take  on  any  reasonable  value. 

Note  that  inhibitory  pulses  are  indicated  by  nega¬ 
tive  A's. 

The  threshold  function  is  given  by  name;  three  are 
currently  available.  They  are— by  name— TYPEl,  TYPE2, 
and  TYPE3,  corresponding  to  those  described  in  RM-3406. 
Other  threshold  functions  may  be  constructed  as  described 
in  Appendix  B. 

Neurons  whose  firing  histories  are  to  be  displayed 
during  the  course  of  a  simulation  must  have  some  non¬ 
zero  mark  appended  to  their  parameter  llsts--as  an 
additional  parameter.  An  asterisk  (*)  has  been  used  in 
the  example  of  Pig.  4. 
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Table  1 

FUNCTIONAL  TYPES  AND  PARAMETERS 


HIHili 

Function^ 

Parameters 

NEURON 

Neuron 

Name,  threshold  resting 
value,  threshold  function, 
absolute  refractory  period 

DELAY 

Delay  element 

Name,  delay 

SQUARE 

Square  wave 

Name,  probability  of  end¬ 
point  firing,  transmission- 
line  delay,  pulse  amplitude 

PULSE 

Standard  pulse 

ditto 

FACIL 

Facllltory  pulse 

ditto 

DEFAC 

Defacllltory  pulse 

ditto 

STABIL 

Stabilizing  pulse 

Name,  probability  of  end¬ 
point  firing,  transmission- 
line  delay,  pulse  amplitude, 
stabilizing  level 

NULL 

Input  to  delay 
element 

Name,  probability  of  end¬ 
point  firing,  transmission- 
line  delay 

LEARN 

Learning 

connections 

Name,  probability  of  end¬ 
point  firing,  transmission- 
line  delay,  pulse  eunplltude, 
name  of  reinforcing  con¬ 
nection  or  set  of  connections, 
forgetting  factor,  number  of 
simultaneous  coincidences 
with  members  of  reinforcing 
set  required  to  trigger  an 
effective  coincidence 

REINF 

Set  of  rein¬ 
forcing  connections 

Name,  names  of  all  con¬ 
nections  In  set 

BASE 

Square  wave  which 
persists  until  par¬ 
ent  neuron  fires 

Name,  probability  of  end¬ 
point  firing,  transmission- 
line  delay,  pulse  amplitude 

®See  RM-3^06. 
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IV.  STIMULI 

These  fxonctlonal  types  are  listed  in  Table  2;  they 
are  treated  as  pseudo-neurons  with  neuronal  naming  con¬ 
ventions  . 

All  times  are  given  In  seconds,  all  rates  are  given 
In  pulses-per-second  (pps),  and  all  reliabilities,  which 
specify  the  probability  of  transmission  of  Impulses  Into 
the  net  from  the  particular  stimulus,  must  lie  In  the 
closed  Interval  [0,l]  . 

The  general  pattern  of  firing  Is:  after  an  Initial 
waiting  period  specified  by  the  pre-firing  time  (tp^), 
firing  Is  initiated;  firing  then  continues  at  the  specl- 
fled  rate  for  a  period  of  time  given  by  the  burst  time 
(ton)*  after  which  firing  Is  delayed  for  the  Inter-burst 
time  the  on-off  cycle  then  repeats.  Methods  for 

controlling  stimuli  In  a  less  stylized  manner  are  de¬ 
scribed  In  Sec.  VII. 

INPUTS  controls  the  firing  by  a  specified  function; 
the  construction  of  such  special-purpose  functions  Is 
discussed  In  Appendix  B. 

BURSTS  Is  clearly  a  special  case  of  INPUTS,  while 
CYCLIC  Is  a  specialization  of  BURSTS  with  t^^f  0  and 
ton  a  very  large  number. 

RANDOM  Is  a  further  specialization  of  CYCLIC  with 
firing  rate  set  at  2000  pps  (firing  at  Intervals  of  t). 
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Table  2 

STIMULI  TYPES  AND  PARAMETERS 


HffiHi 

Pxinctlon 

Parameters 

CYCLIC 

Continuous  firing 
at  constant  rate 

Name,  pre-firing  period, 
firing  rate,  firing  reli¬ 
ability 

BURST 

Bursts  of  continuous 
firing 

Name,  pre-firing  period, 
firing  rate,  firing  reli¬ 
ability,  burst  period. 
Inter-burst  period 

RANDOM 

' Random'  firing 

Name,  firing  reliability 

INPUTS 

Burst  firing  at 
rate  determined  by 
special  function 

Neune,  pre-firing  period, 
name  of  function,  firing 
reliability,  burst  period. 
Inter-burst  period,  two  or 
fewer  parameters  for  the 
function 
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V.  DISPLAY 

The  pseudo-components  listed  on  Table  3  are  used  to 
display  net  status  and  firing  histories  at  specified 
Intervals.  The  display  formats  are  described  in  Appendix 
C.  The  parameters  of  Table  3  are  in  one-to-one  corres¬ 
pondence  with  those  of  Table  2,  with  'display'  replacing 
'firing' . 

PRINTA  and  PiOlNTB  display  a  rather  complete  picture 
of  the  state  of  a  net  (see  Appendix  C),  the  former  oper¬ 
ating  in  a  'burst-wise'  manner,  the  latter  operating 
under  the  aegis  of  a  special  function. 

PRIOTC  displays  firing  histories  for  all  stimuli  and 
all  'marked'  neurons  (see  Sec.  Ill  and  Appendix  C). 

PRIMTD  is  not  used  for  display  purposes;  rather,  it 
is  used  to  save— on  magnetic  tape— the  complete  status 
of  a  net  for  future  editing  or  restart. 
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Table  3 

DISPLAY  TYPES  AND  PARAMETERS 


IBMH 

Function 

Parameters 

PRINTA 

Display  state  of 
net  In  bursts 

Name,  pre-display  period, 
display  rate,  burst  period. 
Inter-burst  period 

PRINTB 

Display  state  of 
net  via  special 
function 

Name,  pre-display  period, 
name  of  function,  burst 
period.  Inter-burst  period 

PRINTC 

Display  firing 
histories 

Name,  pre-display  period, 
rate  at  which  neuron  firings 
are  examined 

PRIMTD 

Save  complete  net 
for  restart 

Name,  pre-operative  period, 
number  of  times  per  second 
net  Is  to  be  saved 

16 


VI.  MET  PARAMETERS 


Net  parameters  are  computational  and  'physiological' 
factors  which  specify  a  common  mode  of  behavior  for  all 
net  components,  as  described  In  Table  4.  The  normal 
values  there  listed  remain  In  effect  unless  changed  by 
the  net  program  (see  Sec.  VII). 

Table  4 
NET  PARAMETERS 


Name 

Normal  Value 

Function 

T1 

0 

The  coincidence 

T2 

10 

upper 

limits  (as  an  Integral 
number  of  btp's)  for 

learning  connections® 

LAMBDA 

.0005 

The  normal  forgetting  rate 

MUO 

5 

1 

MUl 

15 

►  Learning  parameters® 

MUSTAR 

1 

J 

GRAIN 

1 

The  grain  of  the  compu¬ 
tation 

START 

0 

Time  for  Initiation  of  pro¬ 
cessing 

KAPPAl 

KAPPA2 

l/6o 

Parameters  for  facllltory/ 

KAPPA3 

1/3 

defacllltory  connections® 

KAPPA4 

l/6o 

4 

SIGMA 

SIGMAl® 

Synaptic  delay  function 

RZERO 

1111111111 

_ 

An  Initial  random  number 
which  must  be  large  and  odd 

®See  RM-3406. 


VII.  NET  PROQPtAMS 


The  descriptive  language  for  conimunlcatlng  net 
structures  to  NETl  has  been  described;  there  remains  the 
algorithmic  language  for  communicating  programs  of  ex¬ 
perimentation  to  be  carried  out  by  NETl.  Such  programs 
are  presented  as  an  ordered  set  of  directives  or  In¬ 
structions  j  each  such  Instruction  specifying  a  task  to 
be  performed  and,  when  necessary,  the  entitles  on  which 
the  task  Is  to  be  performed.  That  Is,  an  Instruction 
Is  composed  of  an  operation  and  operands,  or  equivalently, 
a  function  and  arguments.  Many  Instructions  are  con¬ 
cerned  primarily  with  operations  on  net  components  and 
net  descriptions;  others  allow  simple  arithmetic  oper¬ 
ations  to  be  performed,  allow  testing  and  Interrogation, 
and  allow  the  user  to  specify  the  order  In  which  NETl 
Is  to  carry  out  the  Instructions.  The  various  classes 
of  Instructions  will  be  discussed  below;  but  first,  a 
brief  uberbllck. 

Nets  originally  exist  on  cards  as  net  descriptions; 
let  us  call  a  set  of  one  or  more  such  descriptions  an 
Input  stream.  Net  descriptions  may  be  called  from  the 
Input  stream  (sequentially),  may  be  saved  on  a  descrip¬ 
tion  file  (magnetic  tape),  and  may  be  recalled  from  a 
description  file;  files  may  be  labelled  and  saved  from 
run  to  run.  Once  called,  a  net  description  may  be  re¬ 
named  and  modified.  Modification  may  Involve  appending 


new  components  to  the  net  description,  amending  existing 

components  (in  toto),  and  changing  specific  component 

4 

parameters  and  component  state  variables .  Net  descrip¬ 
tions,  components,  component  parameters,  and  state 
variables  may  all  be  displayed,  interrogated,  and  tested. 
Net  descriptions  may  be  activated  and  run  for  specified 
periods  of  time.  Activated  nets  cannot  be  saved  on  a 
description  file,  but  may  be  saved  on  a  record  file  for 
future  reactivation  and/or  editing.  All  other  operations 
on  net  descriptions  may  be  applied  to  activated  nets. 

In  addition,  all  nodes — neurons,  stimuli,  and  display- 
in  activated  nets  may  be  turned  off  and  on.  Net  para¬ 
meters  may  be  modified,  tested,  and  displayed  at  any 
time. 

A  net  program  is  a  suitably  delimited  set  of  in¬ 
structions  chosen  from  the  repertoire  of  Table  4  and/or 
the  SCAT^  repertoire.  Instructions  are  presented  to 
NETl  in  standard  form,  with  the  additional  proviso  that 
columns  one  through  six  are  reserved  for  the  (unique) 
Identification  of  any  instructions  referenced  within  the 
net  program.  Such  identifiers  will  be  referred  to  as 
such. 

A  net  program,  possibly  followed  by  one  or  more  net 
descriptions,  is  presented  to  NETl  as  a  set  of  cards. 


4 

See  Table  5. 

^International  Business  Machines  Corporation,  SHATO 
SOS  Reference  Manual— SHARE  Operating  System  for  the 


0-61. 


ppiiea  Frogramming  publications.  Mew  York, 
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Table  5 

COMPONENT  PARAMETERS  AND  STATE  VARIABLES 


Name 

Description 

NAME 

Component  name 

RELIAB 

The  'reliability'  of  a  connection — the  probability 
that  end-point  firing  will  occur 

AMP 

Connection  pulse-amplitude 

COUNT 

Coincidence-count  for  learners 

DELAY 

Connection  transmlsslon-llne-delay 

DELAY 

Delay-element  delay 

POROET 

Porgettlng-factor  for  learners 

level 

Stablllzlng-level  for  STABIL  connections 

MU 

Learning-factor  for  learners 

REINF 

Name  of  reinforcing  knob  or  set— for  learners 

POT 

Neuron  membrane  potential 

RHO 

Neuron  refractory-period 

THBASE 

Neuron  threshold-base-value 

THTYPE 

Neuron  threshold-function 

FIRE 

Number  of  times  neuron  or  stimulus  has  fired 

PUNCT 

Name  of  special  purpose  function 

PARAMl 

Parameters  of  special  functions  for  stimuli  and 

FARAM2 

display 

PROBAB 

Stimulus  reliability 

RATE 

Firing  rate 

TOFF 

Inter-burst  period 

TON 

Burst  period 

TPP 

Time  before  next  firing 

TLEFT 

Time  before  end  of  burst  period 

20. 


NETl  carries  out  the  Intent  of  the  program  by  executing 
the  Instructions  sequentially,  beginning  with  the  first 
Instruction.  Changes  In  sequencing  are  effected  un¬ 
conditionally  by  GOTO,  DO,  and  LEAVE  Instructions,  and 
conditionally  by  TEST  Instructions  and  by  error  condi¬ 
tions.^  Some  Instructions  must  have,  as  an  argument, 
an  Identifier  specifying  the  Instruction  to  be  executed 
In  the  event  of  an  abnormal  condition.  Use  of  the 
Identifier  EXIT  for  such  arguments  will  cause  the  ex¬ 
ecution  of  the  program  to  be  curtailed  by  any  error 
condition  associated  with  the  Instruction.  NETl  will 
comment  on  error  conditions  before  executing  the  Instruc¬ 
tion  supplied  as  an  "error-exit";  the  commentary  should. 
In  all  cases,  be  sufficient  to  explain  the  error. 

Figures  5»  6,  and  7  (pp.  23-25)  exhibit  three  dis¬ 
tinct  sets  of  Instructions  for  performing  the  same 
experiment.  Each  experiment  consists  of  three  runs  on 
the  net,  SANP1£  of  Fig.  4,  with  variation  of  the  forget¬ 
ting  factor  for  the  learning  connection.  Each  run 
lasts  3/10  sec.,  different  stimuli  phasing  In  at  1/10- 
sec.  Intervals.  Firing  counts  for  neuron  22  are  dis¬ 
played  every  ten  seconds,  and  the  learning  factor  for 
the  learning  connection  Is  displayed  at  the  end  of  the 
run. 


^See  Table  6,  p.  26-27. 
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The  examples  show  that  modification  of  net  ele¬ 
ments — components .  parameters,  and  state  variables— is 
accomplished  by  referencing  names,  nvunbers,  and  elements 
Incorporated  within  the  net  program.  In  particular, 
note  that  'indexing'  is  allowed.  That  is,  if  I  and  J 
are  identifiers  and  k  is  any  Integer,  then 

I,k  after 

refers  to  the  k^  instruction  I 

I,-k  before 


and 


I,J  refers  to  the  (J)^^  instruction  before  or 
after  I, 


where 


(j)  means  'the  quantity  identified  by  J.' 

One  caveat:  it  is  essential  that  'lists'  of  instructions 
to  be  referenced  by  indexing  be  coherent;  that  is, 
any  such  list  must  be  a  list  of  names  and/or  numbers, 
a  list  of  elements,  a  list  of  GOTO  instructions,  or  a 
list  of  DO  instructions.  Indexing  over  Incoherent  in¬ 
struction  lists  will  not  be  detected  by  NETl,  and  will 
result  in  unpredictable  errors. 

Program  1  of  Pig.  3  Illustrates  the  use  of  most  of 
the  instruction  classes  of  Table  6.  The  first  instruc¬ 
tion  states  that  a  description  file  is  to  be  made 
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avallable.  In  Program  1,  the  file  Is  to  be  used  to 
save  the  net  SAMPLE  between  runs ;  that  is ,  the  file  Is 
used  as  a  temporary  storage  medium.  The  net  is  flrsu 
called  from  the  Input  stream,  then  displayed  by  the  PRIWT 
Instruction  and  Is  then  saved  on  the  file.  Control  then 
passes  to  TEST2,  where  the  forgetting  factor  (originally 
l.l)  Is  set  and  displayed.  The  run  Is  then  carried  out 
In  one-tenth  second  Intervals,  after  which  the  forget¬ 
ting  factor  Is  decremented  by  1/10  and  Is  tested.  If 
the  forgetting  factor  Is  greater  than  or  equal  to  9/10, 
control  passes  to  TESTl,  where  the  net  Is  recalled  and 
then  to  TEST2  to  begin  the  new  run.  The  displays 
generated  by  the  three  runs  are  given  In  Appendix  C. 

Program  2  of  Pig.  6  Illustrates  the  use  of  sub¬ 
routines,  of  Indexing,  and  of  the  REFER  Instruction. 
Program  3  of  Pig.  7  Is  a  variant  of  Program  1.  Note 
that  both  Program  2  and  Program  3  save  the  description 


file. 
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• 

PROGRAM  1 

READY 

FILE 

DESC.  FILE  TO  BE  USED 

CALL 

SAMPLE lEXI TfCARDS 

CALL  NET  FROM  INPUT  STREAM 

SAVE 

sample 

SAVE  NET  FOR  REUSE 

GOTO 

TEST2 

TESTl 

CALL 

SAMPLEtEXIT 

CALL  FOR  NEXT  RUN 

• 

EXIT 

PROGRAM  ON  ERROR  CONDITIONS 

TEST2 

GET 

TESTl 

FORGET! SlLNOl )>NEW  VALUE 

STORE 

FORGETtSlLNOl 

(ORIGINALLY  «  l.l) 

STOP 

SI 

RUN  FOR  1/10  SECOND  WITH  FL 

STOP 

S2 

AS  SOLE  STIMULI 

PROBE 

SlLNOl 

PRINT  FIRING  HIST. 

ACTIVE 

SAMPLEiTENTHtEXIT 

PRINT 

TESTl 

PRINT 

FIRE»22 

START 

SI 

ACTIVATE  SI 

CONT 

TENTH, EXIT 

PRINT 

FIRE,22 

START 

S2 

ACTIVATE  S2 

CONT 

TENTH, EXIT 

PRINT 

NET 

GET 

TESTl 

DECREMENT  LEARNING  FACTOR 

MINUS 

TENTH 

PUT 

TESTl 

• 

•  CONTINUE  (RETURN  TO  TESTl)  IF  MORE  RUNSt  OTHERWISE  EXIT. 

TEST  FiNALtTESTUEXITtEXiT 
TENTH  NUMBER  .1 

TESTl  NUMBER  U1  LEARNING  FACTOR  I  TO  BE  DECREMENTED) 

FINAL  NUMBER  .8 


FIGURE  5 
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PROGRAM  2 


READY 

FILE 

CALL 

SAMPLE, EXIT, CAROS 

SAVE 

SMPLl 

AMEND 

FIRST 

SAVE 

SMPL2 

AMEND 

SECOND 

SAVE 

SMPL3 

REFER 

TESTA 

00 

RUN 

REFER 

TESTS 

DO 

RUN 

REFER 

TESTC 

DO 

RUN 

CLOSE 

EXIT 

FILE,FILE2 

FORGET( SlLNOl)  >  1.1 
FORGLTlSlLNOn  «  1 
FORGCTt SlLNOl)  «  .9 


SAVE  OESC.  FILE 


•  RUN 

*  NET 


FIRST 

SECOND 

TESTA 

TESTS 

TESTC 

TENTH 


IS  USED  AS  A  SUB-ROUTINE  WHICH  OPERATES  ON  THE 
LAST  REFERRED  TO  BY  A  REFER  INSTRUCTION. 

ENTER  RUN 

CALL  •tEXIT  CALL  NET  BEING  REFERRED  TO 

PRINT  FORGET, SlLNOl 

STOP  SI 

STOP  S2 

PROBE  SlLNOl 

ACTIVE  •, TENTH, EXIT 

PRINT  FIRE, 22 

START  SI 

CONT  TENTH, EXIT 

PRINT  FIRE, 22 

START  S2 

CONT  TENTH, EXIT 

PRINT  FIRE, 22 

PRINT  MU, SlLNOl 

LEAVE  RUN 

LEARN  SlLNOl,!, 16, 20, Rl, 1,2 

LEARN  SlLNOl,!, 16, 20, Rl, .9,2 

NAME  SMPLl 

NAME  SMPL2 

NAME  SMPL3 

NUMBER  .1 


FIGURE  6 
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PROGRAM  3 


READY 

FILE 

CALL 

SAMPLEtEXITtCAROS 

SAVE 

SAMPLE 

ZERO 

COUNTl 

GOTO 

TEST3 

TESTl 

CALL 

SAMPLEtEXI T 

TEST3 

GET 

FGtCOUNTl 

PUT 

FORGETtSlLNOl 

PRINT 

FORGETtSlLNOl 

STOP 

SI 

STOP 

S2 

PROBE 

SlLNOl 

ACTIVE 

SAMPLEfTENTH.EXiT 

PRINT 

FIREt22 

START 

SI 

CONT 

TENTHf EXIT 

PRINT 

FIKEt22 

START 

S2 

CONT 

TENTH, EXIT 

PRINT 

FIRE, 22 

PRINT 

MU, SlLNOl 

GET 

COUNTl 

PLUS 

ONE 

PUT 

COUNTl 

TEST 

THREE, TESTA, TESTl, lESTl 

TESTA 

CLOSE 

EXIT 

FILE,FILE2 

COUNTl 

NUMBER 

ONE 

NUMBER 

1 

THREE 

NUMBER 

3 

TENTH 

NUMBER 

.1 

FG 

NUMBER 

1.  1 

NUMBER 

1 

NUMBER 

.9 

FIGURE  7 
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Table  6 


NETl  INSTRUCTION  REPERTOIRE 


INST 

ARGUMENTS 

INTENT 

CALL 

net  name,  E 

Call  net  from  description  file 

CALL 

net  namei  E,  CARDS 

Call  net  from  input  stream 

SAVE 

net  name,  E 

Save  net  on  description  file 

ACTIVE 

net  name,  I,  E 

Activate  net,  run  for  (I) 
seconds 

CpNT 

I.E 

Continue  run  for  (I)  seconds 

APPEND 

AMEND 

I* 

I* 

Component  Identified  by  I*  is 
amended ,  or  is  appended  to  net 

PI^BE 

Cl,  C2,  ....  C6 

Firing  histories  for  Cl,  C2, 
etc  • ,  are  to  be  display^ 

GET 

I* 

(!')  - >  (PR) 

PUT 

I' 

(PR)  - >  (I.) 

PLUS 

I* 

(PR)  +  (J.)  - »  (PR) 

I* 

(PR)  .  (!•)  - >  (PR) 

TINES 

I* 

(PR)  X  (I* )  - -  (PR) 

DIVIDE 

I' 

(PR)  /  (I*)  - >  (PR) 

ZEiy) 

I' 

0 - -  (!’) 

SETP$IS 

1* 

|(PR)| - (PR) 

I* 

.|(PR)| - >  (PR) 

FETCH 

V.c 

V  [c3 - (PR) 

ST^RE 

v,c 

(PR)  — >  V  rc) 

TEST 

I',  11,  12,  13 

Next  instruction  is 

11  > 

12  as  (PR)  -  (Z* ) 

13  < 

TEST 

11,  12.  13 

Next  instruction  is 

11 

12  as  (PR)  -  0 

13  < 

n 

(n)  - -  (PR) 

STjntE 

n 

(PR)  - >  (n) 

PR] 

urr 

C 

I 

PR 

TT 

V,c 

N^ES 

KNgiBS 

PARAMS 

NET 

MDB,  node  name 

KI^IB,  connection  name 

Seir-sxplanstory,  see 

Appendix  C  for  formats 
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Table  6 — Continued 


XMST 

AROUNENTS 

INTENT 

I* 

Next  inetruotlon  is  I* 

I 

Execute  aub-routlne  I;  continue 
with  next  instruction  upon  com¬ 
pletion  of  sub-routine 

•ub-routln«  namt 

Defines  beginning  of  sub-routine 

LEAVE 

•ub-ro\itlnt  n§mm 

End  (last  instruction)  of  sub¬ 
routine 

EXIT 

End  of  net  program 

NUMBER 

any  number 

*.g..  fs.  1.2,  0, 

NAME 

any  name 

B.g..  '22,  PL.  FL2201} 

CL^B 

FILE,  file  name 

The  description  file  is  to  be 
labeled  and  saved— no  further 
operations  may  be  performed  on 
the  description  file  by  the  cur¬ 
rent  program 

READY 

FIXJS 

A  description  file  is  to  be 
'opened* 

READY 

FIX£»  file  name 

The  description  file  named 
(presxmwbly  saved  from  a  previous 
run)  is  to  be  opened 

REFER 

Future  use  of  an  asterisk  (*) 
for  a  net  name  in  CALL  or 

ACTIVE  will  indicate  that  the 
name  identified  by  I'  is  to  be 

used  as  the  net  name 

STATE 

function  name 

Used  to  declare  special  functions 

STprp 

node  name 

Node  is  inactivated  ]  primarily 

\  for  stimulus 

START 

node  name 

Node  is  reactivated  j  and  display 

UNTIL 

node  name,  X,  E 

Continue  run  until  node  named  has 
fired  (Z)  times 

n 

means 

*'any  net  parameter** 

V 

means 

'*any  variable  listed  in  Table  3** 

C 

means 

"any  component  name** 

i 

means 

'*the  identifier  of  the  instruction  to  be  performed 
in  the  event  of  an  error** 

(PR) 

means 

'*the  result  of  the  previous  arithmetic  operation**  — 
the  ** previous  result** 

I' 

refers 

to  any  of  I  ;  I,K  ;  I,-K  ;  I|I 

vfc) 

means 

**the  variable,  V,  associated  with  component  C** 

(I) 

means 

**the  quantity  identified  by  I** 
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Append  lx  A 

METWORK  CAPACITY  AMD  PROCESSINQ  TIMES 
METWORK  CAPACITY 

Of  the  32 >768  stores  available  In  the  7090,  approxi¬ 
mately  5500  are  usurped  by  the  machine  operating  system 
and  5000  by  NETl.  Thus,  about  22,200  are  available  for 
node/connection  storage--at  12  stores  per  component-- 
and  for  net  programs.  Distribution  of  available  space 
among  nodes  and  connections  Is  not  fixed  a  priori,  but 
calculated  emevr  for  each  run.  Thus,  no  fixed  maximum 
number  of  components  can  be  stated.  However,  assuming 
six  connections  per  node,  a  network  of,  say,  230  nodes 
and  1300  connections  would  leave  ample  room  for  net  pro¬ 
grams  . 

PROCESSINQ  TIMES 

The  processing  tlme--per  network  time  period— Is  a 
function  of  the  size  of  the  net,  of  the  types  of  con¬ 
nections  ,  and  of  the  states  of  cells  (nodes )  and  knobs 
(connections).  Cells  may  be  In  one  of  three  states: 

Cj^  -  Threshold  reached 
Cg  Refractory 
Cj  ~  Nonrefractory 

with  transition  diagram: 

C^  ^3  ^1  * 
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Is  a  special  case  of  C^;  the  transition  Cg  is 

characterized  by  the  processing  time  required  to  calcu¬ 
late  synaptic  delay  and  to  place  signals  on  the  cell's 
efferent  lines;  this  time  can  be  neglected  by  amortizing 
It  over  the  time  the  cell  spends  In  state  Cg  .  The 

transition  Cg  - >  C^  Involves  a  resetting  of  knob  states; 

this  time  may  be  amortized  over  time  In  state  C^  .  Knobs 
may  be  In  one  of  twelve  states,  K^^p^  where  m  Is  the 
number  of  pulses  active  at  the  knob,  n  Is  zero  or  one 
as  a  signal  Is  or  Is  not  arriving  at  knob,  and  p  Is 
one  or  two  as  the  parent  cell  la  or  Is  not  refractory. 
Processing  times  for  states  corresponding  to  n  »  1 
are  equivalent  to  those  for  p  =  2 ,  and  will  be  so  ag¬ 
gregated;  hence,  only  six  states  will  be  timed.  The 
times  below  are  given  in  terms  of  machine  cycles— 2. l8us. 

a)  Cells:  53  cycles  If  In  state  Cg 

29  cycles  ”  ”  C^^ 

b)  Knobs:  22  cycles  If  parent  cell  In 

state  Cg 

l6  cycles  "  ”  Cj^ 

plus  the  following  times  (in  machine  cycles)  dependent 
on  connection  type: 


Type  10 


1  2 

0 

2  6 

1 

2  16 

2 

11  19 

Types  21,  22,  31 »  32 


1  2 

0 

0  6 

1 

0  28 

2 

0  49 

Types  20,  30 


1 

2 

0 

0 

6 

1 

0 

28 

2 

0 

36 

Type 

40 

1 

2 

0 

0 

6 

1 

0 

28 

2 

0 

50 

Learning 


1  2 

0 

96  102 

1 

96  124 

1 

132  132 

Make  two  assumptions: 

1)  Cells  fire  every  twenty  time  periods; 
hence  ratio  of  refractory  to  nonrefractory 
time  Is  approximately  6:1 

2)  Knobs  have  zero,  one,  two  pulses  active 
In  the  ratio  1:2:1 

and  obtain  the  following  average  times: 
a)  Cells  ~  50  machine  cycles 
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b )  Knobs 

21 

machine 

cycles 

Type  10 

13 

II 

II 

Type  20 

21 

II 

II 

Type  21 

24 

II 

It 

Type  4o 

24 

II 

II 

Learning 

118 

II 

11 

Convertlng  machine  cycles  to  actual  time  and  let¬ 
ting  Ng,  ...  refer  to  total  numbers  of  cells, 

loiobs.  Type  10  connections,  ...,  the  processing  time, 

T,  per  time  period  Is: 

T  =  (2.18)  {50Ng  +  21Kj^  +  IBNjq  +  ...)  |is.  (A.l) 

The  estimate  Is  probably  high,  since  assvunptlons  l)  and 
2)  Imply  fairly  high  network  activity. 

A  rough  time-estimate  for  general  nets  may  be  ob¬ 
tained  by  assuming  the  following  distribution  of 
connection  types: 

60^  Standard  pulses 

10^  Learning  knobs 

10^  Facllltory/Defacllltory  knobs 
10^  Stabilizing  knobs 

10^  Rectangular  pulses 

obtaining  £ui  "average”  T  given  by 

'^avg.  i  (109)  (M^j  +  \)  us  . 


(A. 2) 
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Por  a  network  of  250  cells  and  1500  knobs, 

.193  sec.,  which  Is  unconscionably  high,  since  It  means 
that  the  ratio  of  machine  time  to  "physiological”  time 
Is  400:1  '. 
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Appendlx  B 

COMSTRUCTIOM  OP  SPECIAL  PUNCTIOKS 
Subroutines  for  all  functions  must  be  written  In 

7 

SCAT,  with  the  following  boundary  conditions: 

1)  Threshold  functions; 

a)  first  Instruction  Is  ‘BEGIK  1,7' 

b)  (IR2)  on  entry  contains  Index  to 
current  node,  so  that  THBASE  (floating 
point)  Is  obtained  by  addressing 
•THBASE, 2* 

c)  (IRI)  on  entry  contains  time 
elapsed  since  last  firing,  as  an  In¬ 
tegral  number  of  baslc-tlme-unlts 

(i  ms. ) 

d)  (ACC)  on  exit  contains  TH 
(floating  point) 

e)  exit  via  "RETURN*  Instruction. 

2)  Display  and  stimulus  functions: 

a)  first  Instruction  Is  'BEGIN  3,7' 

b)  (IR2)  on  entry  contains  Index  to 
node 

c)  PARAMl  of  subroutine  Is  fetched 
via  'CLA*  1,4'  with  (IR2)  =  (IR2)  on 
entry 

7 

See  footnote  5,  p.  l8. 


d)  (ACC)  on  entry  contains  time — 

In  seconds — since  beginning  of  firing 
(floating  point) 

f)  exit  via  return  Instruction. 

3)  Synaptic -delay  functions: 

a)  first  Instruction  is  'BEGIN  1,7' 

b)  (IRI)  on  entry  contains  time 
elapsed  since  last  time  threshold 
was  exceeded,  as  an  Integral  number 
of  baslc-time-unlts 

c)  (ACC)  on  exit  contains  synaptic 
delay  as  an  integral  number  of  baslc- 
tlme-units  (fixed-point ) . 

NETl  must  be  apprised  of  the  existence  of  any 
special  subroutines.  This  is  effected  by  use  of  'STATE* 
Instructions,  which — when  used — must  be  the  first  In¬ 
structions  In  the  net  program. 
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Appendlx  C 
DISPLAY  FORMATS 

Three  distinct  categories  of  display  format  exist — 
display  of  value,  display  of  component  status,  display  of 
firing  histories.  Examples  of  each  type  are  Included  In 
Pigs.  8-12,  which  give  displays  resulting  from  a  partial 
run  of  Program  1  of  Pig.  5  on  the  network,  SAMPLE,  of  Pig. 

4. 

A  PRINT  Instruction,  whose  argument  Is  the  name  of  a 
state  variable,  a  parameter,  or  a  net  program  variable, 
displays  on  a  single  line: 

time  of  display;  name  of  variable;  value  of  variable. 

Plgure  8  Illustrates  the  format;  the  first  line  resulted 
from  a  PRINT  TEST3  Instruction,  the  last  three  from  a 
PRINT  PIRE,22  Instruction  executed  at  l/lO-second  Inter¬ 
vals. 

Plgures  9-11  are  the  result  of  a  PRINT  NET  Instruction, 
which  Is  equivalent  to  the  Instruction  triplet:  PRINT 
PARAMS,  PRINT  NODES,  PRINT  KNOBS.  Pig.  9  Is  self- 
explanatory.  Each  line  of  Pigs.  10  and  11  Is  the  result 
of  a  component  display;  for  example.  Pig.  10  Is  equivalent 
to  the  sequence  of  Instructions:  PRINT  EN,  PRINT  SI, 

PRINT  S2,  etc.  The  general  pattern  for  components  Is 
given  In  Table  7  below.  Names  of  state  variables  (see 
Table  5)  have  been  used.  Asterisks  (**♦)  preceding  a  node 
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name  Indicate  that  the  node  has  Just  fired.  The  delay 
line  picture,  A ,  Is  a  12-dlglt  octal  representation  of  a 
36-blt  binary  number  corresponding  to  a  delay  line  36 
BTP's  In  length.  Reading  the  number  as  d^  d2  . . .  d^g  , 
a  one  (l)  In  position  d^  Indicates  the  presence  of  a 
signal  that  will  reach  the  connection  In  1  HTP's. 

Figure  12  Is  a  partial  result  of  a  display  of  firing 
histories  (by  a  PRINTC  display  node).  Each  line  gives  a 
100-ETP  history  of  the  component  named — beginning  at  the 
time  Indicated  at  the  head  of  the  display.  Dots  (.) 
Indicate  no  fire;  dollar  signs  ($)  Indicate  fire.  Fig. 

12  Indicates  that  node  EN  has  fired  at  .1993  seconds  and 
continues  to  fire  every  20  HTP's;  i.e.,  at  a  rate  of  100 
pulses  per  second. 


TIf't  * 
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NtTWURK  SAMPLE 
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